Systems, methods, and devices for testing communication lines

ABSTRACT

The invention generally relates to systems, devices, and methods for testing communication lines. In certain aspects, the invention provides systems and devices that include a digital/analog converter configured to operate with a computer processor and memory to send or receive an analog signal over a communication line that includes a plurality of signals having known frequencies. Inbound receiving sub-systems or devices sample the analog signal and measure a quality of the sampled, digital signal to evaluate the communication line. The key differentiator is the recognition that the human mouth and ear are intrinsically analog without encryption. By locating the test device as close to the user as possible, this system incorporates testing of complex communication streams including numerous variables and transforms (e.g. encryption, Analog to digital, Voice over IP, packet switching, ATM, SONET). Ultimately, it provides a simple interface to convert qualitative analysis to quantitative (numerical) analysis.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.14/251,050, filed Apr. 11, 2014, which is a continuation of U.S. patentapplication Ser. No. 13/467,510, filed May 9, 2012, which claims thebenefit of related U.S. Provisional Patent Application No. 61/484,028,filed May 9, 2011, the contents of each of which are incorporated byreference herein in their entirety.

FIELD OF THE INVENTION

The invention generally relates to systems, devices, and methods fortesting communication lines.

BACKGROUND

Communication lines use a variety of different components. For example,phone calls can involve cell phone networks, publically switchedtelephone networks, voice-over-internet protocol, and a wide variety ofdifferent hardware. As service providers implement new technologies, thequality of their communication lines may vary.

Further, many communication systems involve mobile components. Forexample, one end of a phone call may take place on an airplane. Thevariety and mobility of different aspects of communication systems meansthat the quality of communication links is affected by variables thatare constantly changing and unpredictable.

However, system users such as, for example, businesses or military, mayrequire consistent, quality performance from communication systems. If aparticular communication link is not performing up to a certainstandard, important commercial or security-related communication mayfail. To prevent this, communication customers use service-levelagreements to contract for consistent quality service. However, giventhe global scope and high complexity of communication systems, having acontract in place does not guarantee that communication links willalways meet minimum quality standards, such as those set out in SLAs.

Additionally, some communication systems are designed to handle securecommunication protocols that require high quality service across a broadbandwidth. In some cases, the inability of a communication line tosupport secure communication may not be evident. Voice calls may gothrough without problems even though a line is compromised for securitypurposes, for example, due to insufficient quality or a breach ofsecurity.

SUMMARY

The invention generally relates to devices, systems, and methods fortesting communication lines. The invention provides a device that can becoupled to a communication line at one end point and send a signalthrough the line comprising a number of known frequencies. Similarly, adevice can receive the signal at another endpoint of a communicationline. The receiving device samples the received signal to produce adigital signal and analyzes the different frequency components withinthe digital signal for quality. By measuring jitter, phase, signalstrength, or noise, the receiving device can evaluate whether thecommunication line is operating to meet a certain quality standard.Devices and methods of the invention can be used with communicationnetworks having complex, mobile, or variable components to determine ifany given point-to-point communication line is operating at a certainquality. Communication lines can thus be evaluated for their quality asrelevant to voice calls, service level agreements, or securityprotocols.

A key benefit of the invention includes the recognition that the humanmouth and ear are intrinsically analog without encryption. By locatingthe test device as close to the user as possible, this systemincorporates testing of complex communication streams including numerousvariables and transforms (e.g. encryption, Analog to digital, Voice overIP, packet switching, ATM, SONET). Ultimately, it provides a simpleinterface to convert qualitative analysis to quantitative (numerical)analysis.

The invention provides network quality tracking, analyzing, recording,monitoring, and reporting tools. Devices and methods of the inventionare used to measure quality of signals at a number of frequencies andthe results of the measurements are stored. Stored results can beanalyzed and patterns can be identified that indicate issues such asinsufficient quality, trends or changes over time, and securitybreaches. Thus, systems and methods of the invention provide the abilityto evaluate a communication line for an immediate quality determinationas well as for analyzing trends, diagnosing problems, and selectingremedial measures.

In certain aspects, the invention provides a device for testing acommunication line that includes a sampler with a jack for connection toa communication line. The sampler samples an analog signal received overthe communication line. A processor and memory in communication with thesampler measures a quality of a known frequency in the sampled signaland stores the sampled signal and the measurement. The jack on thesampler can be a standard phone jack so that the sampler can be pluggedinto the handset jack on a telephone base unit using a phone cord. Thesampler, or its housing case, can further include another phone jackwhere the handset of the phone can be plugged in. In this way, thesampler device sits between the base unit and the handset of the phone,and connects to the memory and processor, for example, by a USB cable.The memory and processor are preferably provided by a computer, such asa laptop. The computer runs an application that processes the incomingdigital signal or issues a digital signal for sending over thecommunication line.

In this manner, two units of the device can be employed at the endpointsof a live communication line to test a quality of the line. A user canwork at one end in “outbound” mode to cause the device to send a signalthrough the line, which is received by a user at the other end operatingin “inbound” mode. Systems and methods of the invention operate bysending signals that include analog waves at a plurality of knownfrequencies. The processor at the outbound end issues instructions or adigital signal that causes the sampler at the outbound end to sendanalog signals that include the known the frequency. The sampler at theinbound end samples the analog signals and relays the digital version tothe inbound processor, which can save the digital signal to the memory.The inbound processor further analyzes the digital signal, for example,by measuring strength, noise, or jitter at each known frequency. Wherethe inbound and outbound sub-systems are essentially or functionally thesame as each other, they can reverse roles and become the outbound andinbound units, respectively. A sampler is generally anydigital-to-analog or analog-to-digital converter such as anoscilloscope, e.g., a digital storage oscilloscope.

In certain embodiments, systems and methods of the invention operate ina communication mode, sending a number of frequencies of signal throughthe line. For example, the outbound sub-system can send at least two orthree different frequencies. In embodiments, the outbound sub-systemsends at least three frequencies, e.g., sequentially. In someembodiments, the outbound sub-system sends signals at 600 Hz, 1800 Hz,and 3000 Hz, for about seven seconds each, optionally separated by abouttwo seconds. The inbound sub-system receives and digitizes these signalsand analyzes them for noise or jitter, storing the results of theanalysis so that a user can determine if the line is available forcommunication at a certain service quality level.

In certain embodiments, systems and methods of the invention operate ina security mode, sending a greater number of frequencies through theline. For example, the outbound sub-system can send more than five orsix different frequencies such as, for example, ten differentfrequencies. In some embodiments, the security mode includestransmission of signals at 600, 1000, 1200, 1400, 1800, 2200, 2600,3000, 3400, and 3800 Hz, or at 604, 1004, 1204, 1404, 1804, 2204, 2604,3004, 3404, and 3804 Hz.

In certain aspects, the invention provides device for testing atelephone line comprising: a data acquisition device; a universal serialbus connector on the device; and a phone jack, wherein the device,responsive to instructions received via the universal serial busconnector, transmits an analog signal comprising a plurality of knownfrequencies through the phone jack. The device preferably can alsoreceive and sample an analog signal to produce a digital signal andtransmit the digital signal to a computer via the universal serial busconnection. That is, a device according to certain embodiments of theinvention can operate as a digital-to-analog converter (DAC) in outboundmode or analog-to-digital converter in inbound mode. A DAC can beprovided with a ruggedized housing case that includes connectionhardware or jacks. For example, the case can provide the phone jack forconnection to a telephone base unit, a handset jack for connection tothe handset of a phone, or a USB jack for connection, for example, to acomputer such as a laptop.

In certain aspects, the invention provides a kit for testing acommunications line that includes a data acquisition device such as anoscilloscope as well as any of: a universal serial bus cable, a handsetcable, a handset (regular or push-to-talk), a case (e.g., a rugged orshock-absorbing case with a handle, hinged lid, water-resistant gasket,or other features), a laptop, software application, or an instructionmanual.

A kit according to the invention can be deployed with personnel in thefield to test and evaluate communication links at their end-points. Akit can be used to plug into a telephone set, including by not limitedspecial purpose telephones such as military and secure phones, or pluginto an end point of a phone line using an included set, and operate ininbound or outbound mode to send a plurality of analog signals ofvarying frequencies to evaluate the quality of the line according tomethods of the invention.

In certain aspects, the invention provides method for testing acommunication line that includes receiving an analog signal having anumber of known frequencies over a communication line and measuring aquality of the signal to provide the measurement to a user or store themeasurement in a memory device. Any significant or relevant quality ofthe signal can be measured such as, for example, signal strength, signalto noise ratio, signal to noise and distortion (SINAD), jitter, orfrequency. The incoming signal is preferably sampled and the measurementperformed on the sampled, digital version of the signal (e.g., at asampling rate above about 8 or about 10 KHz, or in ranges of 250 KHz orhigher for more granular analysis). The digital version of the signalcan be stored in memory, e.g., a computer-readable medium. In someembodiments, the frequencies are received serially (e.g., separately andone after another) or sequentially (e.g., separately, one after anotherand organized in an order), optionally separated by a brief interval(e.g., two seconds). Each frequency can be received for a duration, forexample, of at least about two seconds. In some embodiments, eachfrequency has a duration of about five seconds or preferably about sevenseconds, optionally separated by an about two second interval. Longerdurations can provide a better baseline for analyzing signal to noiseand other algorithms, while shorter durations can provide more data in agiven operating time period.

The known frequencies can cover any technologically important bandwidth,such as is used for voice or data communication. In some embodiments,the frequencies define a bandwidth of at least about 1000 Hz, e.g.,greater than about 2000 Hz. For example, the frequencies can include afrequency below about 700 Hz (e.g., about 600 Hz) and one above about2000 Hz (e.g., about 3000 Hz), as well as an intermediate frequency(e.g., about 1800 Hz). In certain embodiments, the frequencies are 600Hz, 1800 Hz, and 3000 Hz. In some embodiments, the plurality of knownfrequencies comprises at least five frequencies, i.e., nine or ten, oreleven or twelve.

Methods of the invention can be used to test any suitable communicationline such as, for instance, a telephone line. Any end-to-endcommunication line can be tested, including lines that rely on any oneor more of publically-switched telephone network, wireless network,private network such as a private branch exchange, orvoice-over-internet protocol.

For example, an analog signal can be received over a line and through atelephone base unit, as well as optionally further relayed to atelephone handset.

Methods of the invention include receiving high and very high volumes ofdata such as, for example, greater than two megabytes per second for anumber of seconds (i.e., 15 s, 18 s, 20 s, 30 s). Methods can includereceiving an analog signal corresponding to ambient noise separatelyfrom receiving the analog signal. That is, before, between, or after thesignals of known frequency, a device can be used to record or measureany sounds coming through a live or open line to provide a baseline orreference point.

In some embodiments, methods include a “communication” mode, in whichthe plurality of frequencies comprises a frequency between about 500 Hzand about 700 Hz; a frequency between about 1500 Hz and about 2000 Hz,and/or a frequency between about 2500 Hz and about 3500 Hz. In asecurity mode according to certain embodiments of the invention, theplurality of frequencies comprises more than five (e.g., ten)frequencies, at least one of which is below 1000 Hz and at least one ofwhich is above 3500 Hz. Preferably, the plurality of frequencies includeat least two (e.g., three) frequencies that define a bandwidth greaterthan about 2000 Hz.

Methods of the invention also include operating a device in an outboundmode and sending an analog signal comprising the known frequencies.

Methods of the invention can be used to determine if a communicationline is capable of operating at a certain quality. For example, a usercan provide a criterion such as a threshold value for acceptable jitteror signal to noise and measurements can be made and compared to thethreshold value. In this way, the suitability of the line for certainapplications can be reported to the user.

Methods of the invention can be mediated through a computer interface.For example, a display can be provided that shows an image of part of asignal, such as a graph or waveform showing an amplitude of a receivedsignal at a certain time or frequency.

In certain aspects, the invention provides a device for testing acommunication line in which the device includes a memory coupled to aprocessor configured to exercise program instructions to cause theprocessor to receive an incoming digital signal from an analog digitalconverter—the incoming digital signal including data generated bysampling at a known sampling rate analog audio signal comprising a knownfrequency—and measure an amount of noise associated with knownfrequency. In some embodiments, the analog signal includes a secondknown frequency and the processor further measures an amount of noiseassociated with the second known frequency. The digital signal and anymeasurements can be stored in the memory (e.g., in a database). Thedevice provides information about a quality of the signal to a user. Auser can supply a value for a reference standard, such as a thresholdvalue for jitter or noise, and the processor can compare the measuredsignal to this threshold. By such means, the processor analyzes thesaved signal and evaluates whether a communication channel is capable ofoperation according to the predetermined standard and provide a resultof the evaluation to a user. The quality measured can be noise asindicated, for example, by a signal to noise ratio or by SINAD. Theprocessor can create a display of a graph of the incoming signal showingamplitude on, for example, a computer monitor. In certain embodiments,the device is a computer such as a laptop computer or tablet (e.g.,running Windows operating system).

In some embodiments, the processor is further configured to send adigital signal to a digital analog converter, i.e., to cause theconverter to emit an analog signal including the known frequency and thesecond known frequency.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a system according to certain embodiments of the invention.

FIG. 2 is a diagram of a system according to certain embodiments of theinvention.

FIG. 3 is a flow chart diagramming methods of the invention.

FIG. 4 shows a main menu as displayed on a device.

FIG. 5 shows a screen for setting parameters for a basic test.

FIG. 6 depicts a screen shown during tone generation and sending.

FIG. 7 depicts a screen shown during tone receiving and recording.

FIG. 8 shows a screen for setting parameters for an extended test.

FIG. 9 is a screen shown during receipt and recording of signal.

FIG. 10 shows a screen giving a summary of measurements of qualities ofa signal.

FIG. 11 is a screen showing detailed measurements of qualities of areceived signal.

FIG. 12 shows an interface being used to see a signal-to-noise ratiomeasurement of a 1204 Hz frequency wave in a received signal.

FIG. 13 shows a screen for starting a report including providedmeasurements.

FIG. 14 shows a screen listing records of sent and received signals.

FIG. 15 depicts a summary of a report provided by methods and devices ofthe invention.

FIG. 16 shows a report provided by the invention that includesmeasurements of qualities of signals comprising three known frequenciesreceived according to methods and devices of the invention.

FIG. 17 shows a detailed report provided by methods and devicesinvention that includes measurements of qualities of signals comprisingthree known frequencies received according to methods and devices of theinvention.

FIG. 18 shows a log notes page according to the invention.

FIG. 19 shows a device according to certain embodiments of theinvention.

FIG. 20 is a photo of the device in FIG. 19.

DETAILED DESCRIPTION

The invention generally provides systems, methods, and devices fortesting a communications line or component of a network. Acommunications line, generally, is any telephone or data line thatprovides for data transfer or telephony, and includes—alone or incombination—telephone lines (e.g., publically switched telephonenetworks (PSTN)), data lines (e.g., digital subscriber lines (DSL)),wireless connections (e.g., 3G and 4G cellular connections, Wi-Fi,satellite connections), as well as numerous other lines, public orproprietary (e.g., fiber optic lines, dedicated private lines, DefenseSwitched Network (DSN), Automatic Voice Network (AUTOVON), etc.). Forexample, a person may place phone call from a laptop computer usingvoice-over internet protocol (VoIP) communication services offered underthe Skype mark by Skype Technologies S.A. (Luxembourg City, LU), adivision of Microsoft (Redmond, Wash.). The call may be received by aparty via a rotary phone on a landline connected to the PSTN. A deviceof the invention may be employed at either or both end of the call totest a quality of the network.

The invention includes systems and methods for testing communicationlines in airborne networking systems. Systems of the invention canoperate over communication systems that employ ultra-high frequency(UHF) or narrow band frequency modulation (NBFM) technologies. In someembodiments, a communication line includes push-to-talk transmitters ateither or both ends. A communication line can include a point-to-pointlink or a satellite communication (SATCOM) link (e.g., Ku, C, or X bandsatellite link), and can further include one or more fixed or mobileground entry point (GEP). In certain embodiments, one end of acommunication line is mobile, for example, on a vehicle such as anaircraft (e.g., E-4B National Airborne Operations Center aircraft, E-6BAirborne National Command Post Aircraft, Air Force One, or otheraircraft). Systems and methods of the invention are operable withcommunication networks that provide full-duplex, multi-channel (e.g., 15channel) voice and data communication over a T-1 circuit path. Incertain embodiments, a SATCOM link links an aircraft to a ground networkvia a GEP. Aircraft communication systems are discussed in U.S. Pat. No.6,677,888; U.S. Pub. 2011/0099371; U.S. Pub. 2009/0282469; U.S. Pub.2009/0187976; U.S. Pub. 2007/0077626; and U.S. Pub. 2007/0042774, thecontents of each of which are incorporated by reference herein in theirentirety for all purposes.

In a preferred embodiment, two systems of the invention that aresubstantially similar are plugged into two different phones that arecapable of calling one another. A coordination call is placed, usingeither the phones or another pair of phones, and two users talk over thecoordination call to coordinate use of the systems. At least one of theusers uses their system in outbound mode while the other user userstheir system in inbound mode. The outbound system generates a tone andsends it as if it were an audio tone over the line to the inboundsystem. The inbound system receives and digitizes (i.e., samples) thetone and measures a quality of the tone using a processor. In certainembodiments, the system operates in a basic communication mode and teststhe line with a small number of tones, such as, for example, one, two,three or four. In an alternative or additional embodiment, the systemoperates in an extended mode and tests the line with a larger number oftones, typically five or greater, e.g., ten.

A system for use at one end of a line is depicted in FIG. 1. Typically,a system includes an analog-digital conversion device (ADC) 117. Device117 includes jack 115 for connection to telephone base unit 109, viaphone cord 113. In certain embodiments, device 117 further includes aport for connection to a computing device 125 and optionally a jack forplugging in a handset 129 of a telephone. In some embodiments, computer125 is connected to device 117 by USB cable 121, and handset 129 isconnected to devices 117 via phone cable 133. Base unit 109 connects tocommunication network 105, typically via whatever connection was inplace prior to the use of systems of the invention. That is, theinvention provides systems and methods for testing existing phone anddata lines. Testing lines is discussed in U.S. Pat. No. 5,559,854; U.S.Pat. No. 4,301,536; U.S. Pat. No. 3,965,418; and U.S. Pub. 2009/0168972,the contents of each of which are hereby incorporated by reference intheir entirety for all purposes.

Device 117 generally contains an analog-to-digital converter (ADC) or adigital-to-analog converter (DAC) 269 (FIG. 2). An ADC and DAC 269 aregenerally the same thing, although the invention includes systems thatuse a dedicated ADC or DAC. Generally, DAC 269 is used herein todescribe an ADC, sometimes also called an oscilloscope. An oscilloscopeis generally a synonym for a species of DAC 269. DAC 269 is alsosometimes referred to as a sampler and can be defined by its function,the conversion of an analog signal to a digital signal or the productionof an analog signal.

Any sampler or oscilloscope compatible with systems and methods of theinvention may be used for any one of DAC 269 including, for example, theportable analog oscilloscope model 475A sold by Tektronix (Beaverton,Oreg.). Preferably, DAC 269 is a digital storage oscilloscope, such as,for example, digital oscilloscope model TDS210 sold by Tektronix(Beaverton, Oreg.). Other units that can provide DAC 269 include‘Digital Storage Oscilloscope with Panels’ sold under SKU TOL106C3M orthe ‘DSO Quad—4 Channel Digital Storage Oscilloscope’ sold under SKUTES101D2P, both available on the website called seeedstudio maintainedby Seeed Technology, Inc. (Shenzhen, Conn.). A system of the inventioncan use, for DAC 269, a NI USB-6211 oscilloscope sold by NationalInstruments (Austin, Tex.). In some embodiments, DAC 269 is provided bya DSO-2090 PC USB Digital Oscilloscope 100 MS/S 2ch sold under thetrademark Hantek by VistaTech (Niagara Falls, N.Y.) or the PCSU 1000two-channel USB PC Oscilloscope sold by Velleman, Inc. (Fort Worth,Tex.). Oscilloscopes are discussed in U.S. Pub. 2011/0267036; U.S. Pub.2010/0052653; U.S. Pub. 2003/0219086; and U.S. Pat. No. 6,459,256, thecontents of which are incorporated by reference herein in their entiretyfor all purposes.

In certain embodiments, DAC 269 is provided by the hardware within a PCsuch as, for example, a memory, processor, and soundcard, as configuredthrough the use of a program application. Any suitable program for aPC-based oscilloscope is included in the invention such as, for example,GoldWave v5.67 Digital Audio Editor available from the website ofGoldWave, Inc. (St. John's, Calif.) or Multi-Instrument 3.2 from VirtinsTechnology (Singapore) and available for download from the CNET websitemaintained by CBS Interactive (San Francisco, Calif.).

DAC 269 can also be provided as part of a device 117 having a customform-factor and/or operated by firmware or a field-programmable gatearray configured to generate an analog signal or sample an incominganalog signal, and may include a processor 281 and memory 277 withindevice 117. In some embodiments, DAC 269 is device 117. DAC devices arediscussed in U.S. Pat. No. 5,121,342; U.S. Pub. 2004/0027138; and U.S.Pub. 2003/0034767, the contents of each of which are incorporated byreference herein in their entirety.

In a preferred embodiment, DAC 269 is a digital storage oscilloscopehoused within device 117 and connected to a computer 125 via USB cable121. Use of such a system is illustrated in FIG. 2. As shown in FIG. 2,a first system includes device 117 a connected to computer 125 a via USBcable 121 a. Device 117 a includes DAC 269 a (e.g., a NI USB-6211oscilloscope sold by National Instruments (Austin, Tex.)) connected to abase unit 109 a of a telephone via phone cord 113 a. Handset 129 a isalso connected to device 117 a, through phone cord 133 a. Computer 125 acan be any computer, such as a Mac or a PC type laptop, and generallyincludes input/output hardware 285 a (e.g., keyboard, monitor, mouse ortrackpad, Wi-Fi card, Ethernet connection, CD or DVD drive, touchscreen,USB port, or disk drive). Processor 281 a connected to memory 277 acoordinates the operation of the system and performs steps of methods ofthe invention.

Generally, one such system will operate in outbound mode incommunication with another such system operating in inbound mode. Theinbound and outbound systems can be substantially exactly the same,although they need not be. As shown in FIG. 2, system 201 includes aninbound sub-system having device 117 b (including DAC 269 b) connectedby phone cord 113 b to phone base unit 109 b as well as by USB cable 121b to computer 125 b (that includes input/output hardware 285 b as wellas memory 277 b coupled to processor 281 b). Handset 129 b is connectedto device 117 b by phone cord 133 b.

The inbound system shown in FIG. 2 (DAC 269 b, processor 281 b, andmemory 277 b) tests a communication line in network 249 by receiving ananalog signal sent by the outbound system. Here, DAC 269 b, processor281 b, and memory 277 b provide the essential components of a system fortesting a communication line. These components can be provided by adedicated device 117 b and a computer 125 b, or they can be provided bya single device or other combination of devices with appropriatehardware, firmware, or software to perform the functions describedherein. As shown in FIG. 2, device 117 b is connected to a communicationline through a jack 115 (see, e.g., FIG. 1). Jack 115 may be anystandard phone plug such as a female 4P4C connector. DAC 269 b isprovided by a sampler (e.g., a NI USB-6211 oscilloscope) coupled to jack115. The sampler receives an analog signal through the base unit 109 bof a phone that have been transmitted over the communication line andsamples the analog signal. The analog signal includes one or more“tones” or signal components having a known frequency. As used herein,analog signal, tone, or frequency in a signal refer to a continuouselectronic signal wherein variations in voltage or current can bedescribed as the analog of a sound. An analog signal may be digitizedand transmitted over part or all of a communication line as a digitalsignal (i.e., packets of information according to an internet protocol)and further, a digital signal may be transmitted as electronic impulsesover, for example, copper wires (e.g., a digital subscriber line) orlight impulses over an optical network. Communication over packetnetworks is discussed in U.S. Pat. No. 6,775,240, the contents of whichare hereby incorporated by reference in their entirety for all purposes.Such a signal is an analog signal to the extent that it includesinformation representing analog frequencies, sound, tones, human voicepatterns, or known waveforms.

The sampler samples the received analog signal and provides digital datafor processing by processor 281 b or storage in memory 277 b. Ingeneral, sampling according to the invention is performed at a samplingrate at least double the value of a known frequency in the receivedsignal. For example, in certain embodiments, when the received signalincludes a signal component at 3804 Hz, the signal is sampled at leastat 7608 samples/sec (7.608 KHz), e.g., 10 KHz. In some embodiments, thesignal is sampled at about 250 KHz or about 100 KHz. Methods foranalog-to-digital conversion (i.e., sampling) and digital-to-analogconversion (e.g., tone generation) as well as software and hardware forimplementation are discussed in Smith, S. W., The Scientist andEngineer's Guide to Digital Signal Processing, 1997 California TechnicalPublishing, San Diego, Calif., pp. 34-86, the contents of which areincorporated by reference herein in their entirety.

The incoming signal to be sampled is received via phone cord 113 pluggedinto base unit 109 of a telephone. As used herein, telephone 109,handset 129, phone cord 113, or phone cord 133 are each part of thecommunication line to be tested, the system for testing thecommunication line, or both. In some embodiments, a system is providedthat includes device 117 and computer 125 for testing a communicationline that includes an existing telephone. In some embodiments, a systemis provided that includes device 117, computer 125, and a telephone(including but not limited to traditional analog phones, digital VOIPphones, or Military style encrypted phones) for testing an existingcommunication line, e.g., without regard to whatever phone hardware maybe connected to the communication line.

Preferably, a system according to the invention can operate in inboundmode and in outbound mode. In outbound mode, device 117 sends an analogsignal into the communication line. For example, processor 281 can issuea digital signal and send it to DAC 269. DAC 269 operates to issue acorresponding analog signal including a signal component having a knownfrequency and send the analog signal out.

The communication line is tested by measuring, at the inbound system, aquality of the known frequency signal component that is received.Generally, processor 281 will measure a quality of the sampled,digitized signal. Any quality of interest may be measured such as, forexample, signal strength, jitter, signal-to-noise ratio, signal-to-noisewith distortion (SINAD), frequency, or power. Jitter generally refers toa measure of deviation of instants of a signal from their ideal positionor the variation in period, frequency, or phase of a signal as comparedto its ideal value. Jitter and its measurement are discussed in U.S.Pat. No. 7,339,364; U.S. Pat. No. 6,701,269; U.S. Pat. No. 6,240,130;and U.S. Pub. 2001/0038674, the contents of each of which areincorporated by reference herein in their entirety. SINAD generallyincludes measurements of power level S of a test tone, noise level N,and distortion level D according to (S+N+D)/(N+D). Measuring signalqualities is discussed in U.S. Pat. No. 6,128,510; U.S. Pat. No.5,987,320; U.S. Pub. 2007/0111670; and U.S. Pub. 2004/0161028, thecontents of each of which are incorporated by reference herein in theirentirety.

In certain embodiments, a system of the invention operating in inboundmode receives and digitizes an analog signal comprising a plurality oftones of known frequencies. Preferably, the analog signal is sent by asubstantially or essentially similar system. For example, in someembodiments, the invention provides a system comprising a device 117 anda laptop computer 125 housed together (e.g., in a carrying case). Anynumber of these systems may be deployed with personnel into the field.When a communication line is to be tested, a user connects a system atone end of the line and another user connects a system at the other end.Either or both user operates their system in inbound or outbound mode.The outbound system sends the signal with a plurality of tones (e.g.,three, such as a 600 Hz component, an 1800 Hz component, and a 3000 Hzcomponent) operating in a basic test mode. Another use operates a systemin inbound mode to receive and sample the signals. FIG. 3 is a flowchart diagramming methods of the invention.

As shown in FIG. 3, a user may connect 301 components of the system asdescribed above, and the open 303 a program application (App) forperforming a test. A user can then pick 305 which test—basic orextended—to perform using the main menu shown in FIG. 4.

To perform a basic test, the user can enter 307 data into an informationscreen (FIG. 5) and then pick 309 whether they will operate in inboundor outbound mode. In outbound mode, the user may choose 211 the“generate tone” button (see FIG. 5) and let 313 device 117 send ananalog signal that includes a plurality of tones of known frequencies(e.g., three). When done, the user should close 315 the app. The user atthe receiving end who picks 309 inbound mode will choose 317 the “recordtone” button (see FIG. 5) and let 319 their device 117 receive thesignal. In certain embodiments, the user will hit 321 a stop button(pictured in FIG. 7); view, save, or report any measurements; and close323 their app.

In the extended mode, the steps are substantially similar. A user canenter 331 data into an information screen (FIG. 8) and then pick 333whether they will operate in inbound or outbound mode. In outbound mode,the user may choose 335 the “generate tone” button (see FIG. 8) and let337 device 117 send an analog signal that includes a plurality of tonesof known frequencies (e.g., ten). When done, the user should close 339the app. The user at the receiving end who picks 333 inbound mode willchoose 341 the “record tone” button (see FIG. 8) and let 343 theirdevice 117 receive the signal. In certain embodiments, the user will hit345 a ‘Stop Acquiring Data’ button (pictured in FIG. 9); view, save, orreport any measurements; and close 347 their app.

In certain embodiments, systems and methods of the invention offer abasic test or an extended test and allow a user to pick 305 which teston a main menu displayed on input/output device 285 a (e.g., a monitorof a laptop or a touchscreen of a tablet computer) of computer 125 a. Anexemplary main menu is shown in FIG. 4 and includes a “Comm Test” button403 to choose the basic communication test; a “Report Module” button 407to generate reports; a “Security Test” button 411 to perform securitytests; a “Comm Test Extended” button 415 to perform the extended test;and an “Exit” button 419 to exit the app.

Choosing the “Comm Test” button 403 will bring up the parameter screenshown in FIG. 5. Here, a user at the outbound or inbound end can providedata relevant to the communication line being tested or the test eventitself. Exemplary data that can be received and stored include missiondata (times, dates, numbers, notes), platform number (phone number,software version, hardware or power information), ground entry point/UHFdata (identity of GEP, RF channel, etc.), call information, platformlocation (coordinates, heading, or altitude, particularly where testpoint is on an aircraft), and event information.

Where a user chooses to operate in outbound mode, the user will selectthe “Outbound” radio button under “Connection” as shown in FIG. 5, andclick on the “Generate Tone” button. In certain embodiments, this willinvoke the window shown in FIG. 6, listing outbound frequencies in oneor more of frequency window 625 while illuminating corresponding sendindicator 603.

As indicated by the exemplary screen shown in FIG. 5, systems andmethods of the invention offer a basic level test. In this exemplaryembodiment, an analog signal is sent over the communication line thatincludes three components having known frequencies of 600 Hz, 1800 Hz,and 3000 Hz (see FIG. 6). In certain embodiments, the three tones aretransmitted in series, for seven seconds each, with two seconds ofsilence between each. Program instructions in a computer programapplication stored in memory 277 a are used to configure processor 281 ato send a signal to DAC 269 a causing DAC 269 a to send the analogsignal according to this pattern.

A user operating a system in outbound mode may also make a coordinationcall to another user operating a system in inbound mode. In someembodiments, operation of two systems is coordinated extrinsically, forexample, by two people communicating through a separate phone call, overthe phone line being tested, or by prior arrangement. In certainembodiments, coordination of a system operating in inbound mode with asystem operating in outbound mode is provided intrinsically bycomponents of the system. For example, each system may be programmed tooperate in a quasi-idle “listen” mode whenever turned on or connected toa line. A user may initiate an action at one system that causes it tobegin operation and to send an operating signal to a system at the otherend of the communication line being tested. The operating signal cancause the other system to become active (i.e., no longer be in aquasi-idle “listen” mode). Thereafter, the two systems can function insynchrony or cooperation, for example, either through each following aprogram with compatible timings (e.g., the operating signal causes theoutbound system proceeds to idle for about five seconds, then send asignal for about 20 seconds, and then cease, while the same operatingsignal causes the inbound system to wait about two seconds, then beginreceiving and recording, receive and record for about 27 seconds, andthen stop) or each system following a program with synchronized timings(e.g., inbound system transmits a “go” tone that causes outbound systemto send first signal followed by an “over” tone; upon receipt of “over”tone, inbound signal pauses a second then sends a second “go” signal;this can be repeated until outbound system sends “over and out” signal;then both systems stop). In some embodiments, both systems operate underclock-based synchrony in which, for example, under instructions from oneof the systems or extrinsic input, inbound system begins recording at apre-selected time (e.g., 10:00:00) and stops recording at a preselectedtime (e.g., 10:00:26) while outbound system transmits for seven secondsbeginning at the pre-selected time, followed by two seconds of silence,then another seven second signal, another two second silence, and afinal seven second signal.

In certain aspects, systems and methods of the invention include aserver computer operable to communicate with one or more of computer125. For example, in certain embodiments, one or more system as depictedin FIG. 1 is connected to a network (e.g., permanently or in “standby”mode) and a server computer periodically triggers operation of one ormore of DAC 269 and processor 281 to perform operations of methods ofthe invention. In this way, systems and methods of the invention can beemployed to test a communication line automatically, i.e., without humanparticipation or intervention. Computer 125 can be communicativelycoupled to a server computer via an internet connection such as anEthernet cable plugged into an Ethernet port, a 3G or 4G cellular modem,or via a Wi-Fi connection provided by a Wi-Fi card. One skilled in theart will recognize that most computers suitable for use as computer 125(e.g., laptops, desktops, iPads, smartphones, tablets, etc.) include atleast one such data connection device. In a server-client embodiment, aserver can coordinate the operation of systems of the inventionoperating in inbound mode, outbound mode, or both. Also or in thealternative, a server can manage data collection, analysis, or storage.Any signals received, measurements of those signals, logs, summaries,notes, or other data can be sent to a server for storage or analysis.

Where a user chooses to operate in inbound mode, the user will selectthe “Inbound” radio button under “Connection” as shown in FIG. 5, andclick on the “Record Tone” button. In certain embodiments, this willinvoke the window shown in FIG. 7, showing information about thereceived, sampled, and recorded inbound signal.

The inbound recording and analyzing window can display a graph ofamplitude per frequency, a graph of an incoming wave, a sampling rate,other information about sampling, or any other data that may be usefulto the tester. In certain embodiments, an inbound window will display anelapsing time counter or an amount of inbound date (e.g., in MB)received and saved. The display may also include file path, missionparameters (e.g. participant IDs, information about the types andidentities of components in the communication line), information aboutthe local system (crypto card installed, computer type, sampler type),or other information.

In certain embodiments, the inbound recording window presents GUIcontrols to a user including preferably a stop button. During recording,a user may be presented with GUI elements for controlling the sampler(e.g., change the sampling rate, pause or suspend sampling, cause thesampler to “barcode” the incoming tone signal with additional digitaldata) or for controlling the computer (e.g., cause the computer to“barcode” the data or add metadata tags identifying a unique time pointof interest within a signal or adding information about the signal orsession, turn off the computer's Wi-Fi card or other hardware, triggerthe operation of another computer application to, for example, analyze,save or report data).

A system of the invention operating in outbound mode can barcode anoutgoing tone signal. To barcode a signal refers to adding data, such asanalog or digital codes, that communicate information. For example, ananalog signal can be sent that includes a component of a known frequencyand a barcode component, such as a metadata tag that can be detected andinterpreted by a receiving device. A barcode or tag can include a uniqueidentifying number or other data.

In certain embodiments in which inbound and outbound systems aresynchronized, run automatically, or are extrinsically controlled (e.g.,by their own internal clocks, via a prior extrinsic coordination call byhumans, by a server, by a series of control signals from one system tothe other), windows, GUI elements, and interfaces at one end or theother may be displayed with minimal information, or no user controls, ornot displayed whatsoever. For example, in certain embodiments, operationof an outbound system sends control signals that “wake up” the inboundsystem and control its operation. In this exemplary embodiment, theinbound system may not display the window shown in FIG. 7, or maydisplay a “grayed out” or non-interactive version. Input/outputmechanism 285 b of inbound system computer 125 b may not even include amonitor, touchscreen, or video display. For example, where one system isautomatic and operates without human intervention (e.g., by controlsignals from another system, a server, or a CRON utility within itself),input/output mechanism 285 b may consist of a data connection such as anEthernet port, Wi-Fi card, or phone jack.

For example, in certain embodiments, an inbound system or outboundsystem is controlled solely or primarily for sending and receiving by acron table (e.g., where computer 125 functions on a UNIX or LINUXoperating system). A shell script, Perl program, or like can be writtenand stored in memory 277 in a bin sub-directory of a usr directory, thescript including all commands to execute program applications of theinvention at scheduled times.

In certain embodiments, an inbound system functions by “pinging” aremote computer causing the remote computer to send an analog signalback to the inbound system. For example, the remote computer can be aserver configured to receive send requests and to the respond to them bysending a signal according to the invention. A server can be operablycoupled to DAC 269. For example, the server can be a Hitachi ComputeBlade 500 computer device sold by Hitachi Data Systems (Santa Clara,Calif.). The server can include a E5-2600 processor sold under thetrademark Xeon by Intel Corporation (Santa Clara, Calif.). Remote DAQ269 can be a 6000L series oscilloscope or similar (e.g., the DSO6054L,DSAX96204Q, or MSO9404A) sold by Agilent Technologies, Inc. (SantaClara, Calif.). Program instructions on the server can respond to actionof the inbound system by causing the server and remote DAQ 269 tooperate as an outbound system, i.e., without a human user present at theserver. Testing systems and equipment are discussed in U.S. Pat. No.7,460,983, the contents of which are incorporated by reference in theirentirety.

Viewing inbound recording screen as shown in FIG. 7, a user operates asystem of the invention to receive over a communication line an analogsignal, sample the analog signal, and measure a quality of a componentof the signal having a known frequency. Generally, in a basic test mode,a signal will include a number of components having a known frequency,such as two or three. As shown in FIG. 7, a system is provided thatexpects to receive a 600 Hz signal, a 1800 Hz signal, and a 3000 Hzsignal.

Inbound computer 125 records or saves these digital copies of thewaveforms and measures their qualities. By measuring the quality of thesignal received across a number of wavelengths, the system gives ameasure of the quality of the communication line across a bandwidth. Anynumber of components of known frequency may be received, and preferablythey will span at least about 1000 Hz of bandwidth, e.g., at least about2000 Hz. In certain embodiments, at least one frequency is below about1000 Hz (e.g., about 600 Hz) and at least one is about 2500 Hz (e.g.,3000 Hz). The plurality of known frequencies may include a frequencybetween about 500 Hz and about 700 Hz, one between about 1000 Hz andabout 1500 Hz, and optionally at least one more above, below, within oneof, or between those ranges. Any set of frequencies may be used.Generally, a frequency is known in that it is specified by at leasteither input of a user operator (e.g., at the outbound system) orcomputer program instructions. For example, a user of a system of theinvention may not know the frequency if known refers to the frequencyhaving been specified by instructions in the computer program. Anoutbound or inbound user may not see or “know” the value of thefrequency for example, in embodiments of the invention in which a verysimple, user-friendly interface is provided. In some embodiments,frequencies are not known, for example, by the inbound user or by anyprogram instructions in the inbound system. The system samples aninbound analog signal and optionally measures the frequency ofcomponents of the signal. Thus, the invention provides systems, methods,and devices for receiving an analog signal the includes a componenthaving a frequency and sampling the signal and measuring a quality ofit. A user may not know the frequency, either prior to using the systemor ever, and the frequency may not be specified within the computer codein the system, for example, prior to operation.

Processor 281 on the inbound system can operate to measure a qualitysuch as frequency, power, jitter, signal-to-noise (SNR, in dB), orsignal to noise and distortion (SINAD). In certain embodiments, theinbound system samples the analog signal and stores a digital copy ofthe signal in memory 277. Inbound computer 125 then sends the digitalcopy to another computer (e.g., as an email attachment; using a filetransfer protocol (FTP); via a secure file transfer protocol (SFTP);through operation of an scp command—for example, in a cron table; orsimilar means) where a quality of the signal is measured. While thesignal that is sent to, and received by, the inbound computer is ananalog signal (i.e., for testing the quality of the communication linefor communication via electronic pulses), transfer of a digital copy ofthe file can be by any means. For example, the digital file can be sentas packets according to a transmission control protocol (TCP) or a userdatagram protocol. The digital file may be sent via the communicationline being tested, or may be sent using an independent channel. Toillustrate, in some embodiments, an analog signal is received throughphone line 133 into a phone jack 115 on device 117, as shown in FIG. 1,and a digital copy of the sampled analog signal is sent as an emailattachment or via FTP over a local Wi-Fi network through the use of aWi-Fi card on computer 125 after which the digital copy may be forwardedback to the outbound computer, to a server computer, or to anotherdevice. Accordingly, in certain embodiments, measurements are performedwithin the inbound system (i.e., by processor 281 on inbound computer125) while in some embodiments, a quality of a known frequency in thesample signal is measured by a remote processor in a computer that isindependent from inbound computer 125 (e.g., a server computer or theoutbound computer, where here, “remote” is used simply to specific thatthe processor is not the processor of computer 125) and the remoteprocessor is in communication with the sampler via the mediatinginfluence of a communication line, the computer 125, or a combinationthereof. Secure communication is discussed in U.S. Pub. 2011/0135093;U.S. Pub. 2007/0177578; U.S. Pub. 2005/0058122; and U.S. Pub.2002/0051463, the contents of each of which are hereby incorporated byreference in their entirety for all purposes.

In certain aspects, systems and methods of the invention offer anextended test that includes a greater number of known frequencies in ananalog signal for testing a communication line and providing moreinformation that is provided by a basic test.

An extended test according to certain embodiments of the inventionincludes sending or receiving an analog signal that has a number ofcomponents of known frequencies such as, for example, 8, 9, 10, 11, or12 different known frequencies. Generally, at least three knownfrequencies will be included in an extended test, preferably about fiveor more.

When a user of a computer 125 chooses the “Comm Test Extended” buttonfrom the main menu (FIG. 4), they will be taken to the extended testparameters screen shown in FIG. 8. Operation of the extended testinvolves substantially similar steps and functions as the basic test, asdescribed above. However, an extended test will generally involve asignal that includes more components in the analog signal than with abasic test.

The extended test tool is useful in identification of circuits and theirrespective components that perform at the minimal margins ofacceptability or do not meet the minimum performance characteristics.There are instances where the communications channel allows normal voicecommunications but prevents successful secure communications. Thisphenomenon can occur, for example, when the traditional measure ofcircuit quality, the signal to noise ratio, is well within acceptedtolerances. To achieve the necessary data rates within the limitedbandwidth of a telephone switched circuit devices, systems use a phasemodulation scheme. To identify sources of problems when the end-user cantalk “in the clear” but cannot use the telephone to “go secure,” methodsand systems of the invention provide a quality measurement such asphase, jitter, and distortion and can use a plurality of audio tones(e.g., 10) to sweep the entire audio bandwidth of the selected channel.

Information about the received signal as shown in FIGS. 9-12 areprovided for troubleshooting and maintenance of communication networkcomponents. With this information, technical personnel can pin pointsources of trouble and affect repairs keeping system downtime to aminimum. In certain embodiments, a ten-tone method takes just over 30seconds to run.

After running the receiving and recording steps, a user may return to aparameter screen such as, for example, one of the ones shown in FIGS. 5and 8, and edit or update parameter information. Some fields willpre-populate based on the entries of previous fields. Field descriptionsmay appear associated with the fields. In some embodiments, it is notrequired to enter the information to run a test.

FIG. 9 is a screen shown during receipt and recording of signal in anextended test. As can be seen, aspects of the incoming signal to bemeasured can include peak frequency, noise, jitter, and SINAD. As shownin FIG. 9, an extended test can involve receiving a signal that includesten expected frequencies (e.g., here, 604 Hz, 1004 Hz, 1204 Hz, 1404 Hz,1804 Hz, 2204 Hz, 2604 Hz, 3004 Hz, 3404 Hz, and 3804 Hz—also shown inFIG. 10). Receiving and sampling the signal can include measuring apower spectrum across frequencies or measuring an amplitude or waveformof an incoming signal. Other tones, frequencies, durations, orintervals, or combinations thereof, may be used.

In certain embodiments, a user will view the record signal screen shownin FIG. 9 while communicating with a sender via a coordination call.When the sending system is done sending, the receiving user will hit the“Stop Acquiring Data” button (FIG. 9). In some embodiments, starting,stopping, or other steps are automated, synchronized, or under externalcontrol. For example, in certain embodiments, the analog signal that issent by the outbound system includes a control tone or code that signalsto the receiving system to do something. For example, an certain tonecan trigger the receiving computer to stop acquiring data.

FIG. 10 shows a screen giving a summary of measurements of qualities ofa received signal that may be shown after or during receiving the analogsignal. FIG. 11 is a screen showing detailed measurements of qualitiesof a received signal. FIG. 12 shows an interface being used to see asignal-to-noise ratio measurement of a 1204 Hz frequency wave in areceived signal.

Referring to FIG. 9, the inbound tester can monitor the testing processusing the record and analyze screen. The tester has immediate feedbackgraphically indicating signal to noise ratios, jitter, signal strength,and SINAD (signal to noise with distortion). In some embodiments, device117 samples the incoming signal at a sampling rate greater than 100 KHz,e.g., 250 KHz. The received files can become very large.

After stopping recording, in certain embodiments, the system performsanalysis, calculates the values from the recorded signals, and presentsthe information in an easy to read tables. A table can be shown as inFIG. 10 that is color coded, labeled, tagged, marked, or shaded toprovide immediate feedback to the tester for any parameter that iswithin or outside of accepted tolerances.

The analysis summary can be shown on screen as in FIG. 10. Theparameters in this screen may be differentially shaded for illustrativepurposes. For a more comprehensive view of any given parameter, thetester may select the Analysis Detail tab or double-click on any one ofthe items in the table. An exemplary analysis detail tab is shown inFIGS. 11-12.

The module can display the details with respect to the recorded 604 Hztest tone (shown in the Analysis Detail, FIG. 11). Systems of theinvention can include any useful GUI elements such as icons that allowpan and zoom of the information or waveforms. Using the icons allowsdetailed analysis of the received signal. Analysis can be narrowed downto a precise moment in time or used to highlight a particular anomaly.Systems of the invention may present detailed information on any testfrequency or resultant calculated parameter. Clicking on any calculatedparameter on the “Analysis Summary” page can bring up the details of thecollected signal. When the inbound tester selects the exit box, thesystem may bring up the information screen (e.g., one of the ones shownin FIGS. 5 and 8) for any post-testing notes the inbound tester may wantto include.

The tool can send the information to a database in memory 277 and canadvance the test increment counter by one.

In certain embodiments, after the stop button is pressed, theapplication will calculate the Signal to Noise and Jitter for each ofthe tones on that run (actual time may be determined by load on themachine and the size of the file captured).

In some embodiments, a device of the invention can receive a criterionand compare an aspect of the measured signal to the criterion toevaluate the tested communication line. For example, where a highsignal-to-noise measurement is desired, a criterion of about 40 or about50 can be established, and the application can report a positive resultif the threshold is met or exceeded. Where a low jitter is desired, athreshold can be established (e.g., 0.0001) and a test can evaluate ifthe threshold is met. Adjustment of the tolerances is easy and normallyleft to dedicated expert personnel. (E.g. The previously accepted limitfor signal to noise may have been 35 dB. The supervisory personnel wantthe new minimum standard to be 45 dB. Where a signal to noisecalculation of 40 dB would be “green” acceptable, with the new acceptedlevel of 45 dB, this parameter will have a red flag.) The process issimple and far end testing personnel can make on-scene adjustmentsfacilitated by other personnel talking them through the parameterchanges.

The database can store an electronic copy of the waveform and calculatedparameters. The advantage of keeping all of the calculated informationand signals is in post-testing analysis. The stored waveforms can laterbe used or analyzed repeatedly with new algorithms if necessary ordesired to further identify sources of problems. Stored waveforms can beused at a receiving system, sending system, or other computer (e.g.,server, terminal, or another independent computer) while running a testor later for generating, viewing, sending, or saving reports.

FIG. 13 shows a screen for starting a report including providedmeasurements. In some embodiments, systems of the invention include areport module. A report module can open into the Log Analysis Reportpage (FIG. 13), where a user can click the “File” Button in the lowerleft hand corner to select and open a log file. The select box may opento the directory of collected log files. The log files names can use atimestamp to make it easier to identify which file to report on based onthe original creation date and time of the file.

FIG. 14 shows a screen listing records of sent and received signals. Auser may identify the desired log file and select it. The file will openin grid view so that the user can see all of the information that wascollected. In some embodiments, there is a scroll bar on the side andbottom to facilitate large data sets, and a user may use these if thedesired field is not immediately visible. These fields match back to thequalities tested during receiving and each column links to a particulardata field that was collected during the test. Each row represents 1test. Since each test involved an inbound piece and an outbound piece,there may be blanks in the Signal to Noise and Jitter Analysis fieldsfor those test runs where a system was in “outbound” mode. This isbecause outbound mode can send the preset tone signal without recording.

A user may create a report for analysis or sharing of the data bypressing a button such as a “Create HTML Report” button. A pop-up mayreport the creation of the report and the report will automatically open(e.g. in a computer application such as, for example, Internet Explorer,a word processor, or a dedicated app) for viewing. In certainembodiments, the report is in HTML or another format, such as HTML5 orXML.

In some embodiments, the report is broken up into several sections asshown in FIG. 15. The first section, “Log Analysis” provides a goodoverview of the other three sections so that this report can stand onits own and be used for after action reviews, shared with variousinterested parties by itself, or as a part of a larger report.

FIG. 16 shows a report provided by the invention that includesmeasurements of qualities of signals comprising three known frequenciesreceived according to methods and devices of the invention. Theexemplary “Log Analysis Summary Page” shown in FIG. 16 can display theresults of a number of simple metrics performed on the data and give anoverview of the work that went into this report and the overall successrates of the data collection for that test run.

FIG. 17 shows a detailed report provided by methods and devicesinvention that includes measurements of qualities of signals comprisingthree known frequencies received according to methods and devices of theinvention. The “Log Detail Page” shown in FIG. 17 can provide detailssimilar to the grid view for deeper analysis and inclusion in furtherreports. This section can split out the comments (designated by anasterisk) for improved formatting and printability.

FIG. 18 shows a log notes page according to the invention. The exemplary“Log Notes Page” shown in FIG. 18 can contain the comments (e.g., linkedto the “Log Detail Page” above) in an easy to read and print format. Toview them all together, a grid view may be provided, or the contents canbe sent to one or more CSV files directly using Excel or a similar tool.

In certain aspects, the invention provides a device for testing acommunication line such as is shown in FIG. 19. The devices shown inFIG. 19 can be coupled to computer 125, which includes a memory coupledto a processor that can execute instructions that cause the processor toreceive an incoming digital signal from an analog to digital converterdevice 117, as shown in FIG. 19. Computer device 125 can then save theincoming digital signal to memory, measure a quality of the signal(e.g., noise, strength, signal-to-noise, SINAD, frequency, or jitter),and provide information about a quality of the signal. FIG. 19 shows anembodiment of a device of the invention that can be linked via USB to alaptop computer (e.g., a PC-compatible computer such as a Dell LatitudeE6520 PC laptop available from Dell Inc. (Round Rock, Tex.)). In oneembodiment the laptop is capable of running an operating system. In oneembodiment, that operating system is Windows 7 or Windows XP. In oneembodiment, the operating system has been configured according to theStandard Technical Implementation Guidelines (STIGs) for Department ofDefense systems, the contents of which are incorporated herein byreference in their entirety (see, for example, Windows 7 SecurityTechnical Implementation Guide, Version 1, Release 8, dated Apr. 27,2012, available as a downloadable PDF file from the Security TechnicalImplementation Guides (STIGs) page of the Information Assurance SupportEnvironment web page maintained within the web site of the DefenseInformation Systems Agency (DISA) (Fort Meade, Md.) of the United StatesDepartment of Defense).

FIG. 20 is a reproduction of a photo of the device shown in FIG. 19.

In one embodiment, the invention comprises a module or a client and aremote computer or a server. The module can be configured to beconnected to a network via a network interface point. The module can beconfigured to be connected to the remote computer. The remote computermay comprise software which performs at least one step of the invention.An aspect or step of the invention which may happen on the remotecomputer can include, but is not limited to: signal generation;recording; analysis; saving data to a log file; conversion betweenanalog and digital; collecting and saving information. In thisembodiment, a user may interact with the software on the remote computerthrough a web-browser, a custom application, a command-line interface orother means. In one embodiment, only a portion of the steps of theinvention takes place on the remote computer. In one embodiment, any ofthe steps of the invention may take place on the module or client.

In some embodiments, a module of the invention comprises or consists ofa cell phone, smart-phone, iPhone, iPad, PDA, other portable device,handheld device, or similar device.

One or more step of the invention may be performed automatically, or maybe scheduled to be performed ahead of time. Software on a computer orserver can run and perform a step of the invention automatically. Forexample, software in a module runs and causes software on a server torun. In one embodiment, a module can both send and receivesimultaneously, for instance, through a “looped” communication line, orby employing two network interface points on a single module or device.Each of the modules can use a combination of hardware and software thatcan be customized for a physical operating environment as well assoftware that can be optimized to mission goals and objectives.

The invention provides systems and methods that present a simplifieduser experience and provide complex capabilities to people who are notexperts such as telecommunications engineers, or in other similarlycomplex and necessarily detailed field of study

A module of the invention can contain deep knowledge of a network orcomponent. A module of the invention can make decisions on theinformation that is derived by operating the module by encapsulatingbasic rules simulating that subject matter expert. A module of theinvention can provide a complex policy engine that can extend theorganizational policy to a distant and temporary network or component bydeploying those policies through a policy model. A module of theinvention can supply knowledge and provide guidance for a layman thatwould otherwise require a subject matter expert. A module of theinvention can enable an operator to extend his knowledge into the fieldof the subject matter expert and complete his mission as if he had thebenefit of a subject matter expert beside him.

In order to provide to non-experts the ability to test a communicationline and identify defects, make a determination of a suitability forsecure operation, or establish an available bandwidth or capacity, theinvention provides a simplified user experience that provides meaningthat is visually obvious to a complex security landscape by applying aconfigurable policy to the events generated by the industry leadingmodules for security and testing that have been installed into the unit.In some embodiments, systems and methods of the invention are simpleenough for a non-expert to use. Secure communication is discussed inU.S. Pat. No. 7,188,180; U.S. Pat. No. 6,839,759; and U.S. Pub.2007/0177578, the contents of each of which are incorporated byreference herein in their entirety for all purposes. By not being toocomplicated for a lay-person to use, a module of the invention can avoidits being misused or not used at all. As a result, security breaches areavoided where, otherwise, users may not establish that a line is capableof going secure yet use that line for intended secure operationnonetheless, allowing important secured information to be compromised.

Systems and methods of the invention may generally be implementedthrough the use of one or more of computer 125. Computer 125 generallyincludes a processor 281 operably coupled to a memory 277 and configuredto send or receive information via input-output device 285.

One of skill in the art will recognize that processor 281 may beprovided by one or more processors including, for example, one or moreof a single core or multi-core processor (e.g., AMD Phenom II X2, IntelCore Duo, AMD Phenom II X4, Intel Core i5, Intel Core i& Extreme Edition980X, or Intel Xeon E7-2820). In certain embodiments, computer 125 maybe a tablet or smart-phone form factor device and processor 281 can beprovided by, for example, an ARM-based system-on-a-chip (SoC) processorsuch as the 1.2 GHz dual-core Exynos SoC processor from SamsungElectronics, (Samsung Town, Seoul, South Korea).

Input-output device 285 generally includes one or a combination ofmonitor, keyboard, mouse, data jack (e.g., Ethernet port, modem jack,HDMI port, mini-HDMI port, USB port), Wi-Fi card, touchscreen (e.g.,CRT, LCD, LED, AMOLED, Super AMOLED), pointing device, trackpad,microphone, speaker, light (e.g., LED), or light/image projectiondevice.

Memory 277 generally refers to one or more storage devices for storingdata or carrying information, e.g., semiconductor, magnetic,magneto-optical disks, or optical disks. Information carriers for memory277 suitable for embodying computer program instructions and datainclude any suitable form of memory that is tangible, non-transitory,non-volatile, or a combination thereof. In certain embodiments, a deviceof the invention includes a tangible, non-transitory computer readablemedium for memory 277. Exemplary devices for use as memory 277 includesemiconductor memory devices, (e.g., EPROM, EEPROM, solid state drive(SSD), and flash memory devices e.g., SD, micro SD, SDXC, SDIO, SDHCcards); magnetic disks, (e.g., internal hard disks or removable disks);magneto-optical disks; and optical disks (e.g., CD and DVD disks). Theprocessor and the memory can be supplemented by, or incorporated in,special purpose logic circuitry.

The subject matter described herein can be implemented in a computingsystem that includes a back-end component (e.g., a data server), amiddleware component (e.g., an application server), or a front-endcomponent (e.g., computer 125 having a graphical user interface or a webbrowser through which a user can interact with an implementation of thesubject matter described herein), or any combination of such back-end,middleware, and front-end components. The components of the system canbe interconnected through network 249 by any form or medium of digitaldata communication, e.g., a communication network. Examples ofcommunication networks include cell network (e.g., 3G or 4G), a localarea network (LAN), and a wide area network (WAN), e.g., the Internet.

The subject matter described herein can be implemented as one or morecomputer program products, such as one or more computer programstangibly embodied in an information carrier (e.g., in a non-transitorycomputer-readable medium) for execution by, or to control the operationof, data processing apparatus (e.g., a programmable processor, acomputer, or multiple computers). A computer program (also known as aprogram, software, software application, app, macro, or code) can bewritten in any form of programming language, including compiled orinterpreted languages (e.g., C, C++, Perl), and it can be deployed inany form, including as a stand-alone program or as a module, component,subroutine, or other unit suitable for use in a computing environment.Systems and methods of the invention can include instructions written inany suitable programming language known in the art, including, withoutlimitation, C, C++, Perl, Java, ActiveX, HTML5, Visual Basic, orJavaScript. In certain embodiments, systems and methods of the inventionare implemented through the use of a mobile app. As used herein, mobileapp generally refers to a standalone program capable of being installedor run on a smartphone platform such as Android, iOS, Blackberry OS,Windows 8, Windows Mobile, etc. For example, in certain embodiments, DAC269 is provided by a mobile app such as OsciPrime Oscilloscope byNexus-Computing (Baden, CH) or Oscilloscope Pro by NFX Development,available for Android operating systems from the Google play app storefrom Google (Mountain View, Calif.). A mobile app can also includesampler or DAC functionality developed in an integrated fashion withmobile app program instructions that operate to perform a test ininbound or outbound mode. For example, in certain embodiments, a systemoperating in outbound mode is provided by a smartphone or tablet, eitherconnected to a telephone, or using an internet connection with, forexample, a VoIP. The outbound device sends an analog signal including acomponent having a known frequency. Additionally or alternatively, insome embodiments an inbound system is provided by a smartphone ortablet, for example, by a mobile app that receives an analog signal,samples it, and measures a quality of a component of known frequency.Functionality of the invention can be implemented by a mobile app or asoftware application or computer program in other formats includedscripts, shell scripts, and functional modules created in developmentenvironments.

A computer program does not necessarily correspond to a file. A programcan be stored in a portion of a file that holds other programs or data,in a single file dedicated to the program in question, or in multiplecoordinated files (e.g., files that store one or more modules,sub-programs, or portions of code). A computer program can be deployedto be executed on one computer or on multiple computers at one site ordistributed across multiple sites and interconnected by a communicationnetwork.

A file can be a digital file, for example, stored on a hard drive, SSD,CD, or other tangible, non-transitory medium. A file can be sent fromone device to another over network 249 (e.g., as packets being sentbetween a server and a client, for example, through a Network InterfaceCard, modem, wireless card, or similar).

Writing a file according to the invention involves transforming atangible, non-transitory computer-readable medium, for example, byadding, removing, or rearranging particles (e.g., with a net charge ordipole moment into patterns of magnetization by read/write heads), thepatterns then representing new collocations of information aboutobjective physical phenomena desired by, and useful to, the user. Insome embodiments, writing involves a physical transformation of materialin tangible, non-transitory computer readable media (e.g., with certainoptical properties so that optical read/write devices can then read thenew and useful collocation of information, e.g., burning a CD-ROM). Insome embodiments, writing a file includes transforming a physical flashmemory apparatus such as NAND flash memory device and storinginformation by transforming physical elements in an array of memorycells made from floating-gate transistors. Methods of writing a file canbe invoked manually or automatically by a program or by a save commandfrom software or a write command from a programming language.

INCORPORATION BY REFERENCE

References and citations to other documents, such as patents, patentapplications, patent publications, journals, books, papers, webcontents, have been made throughout this disclosure. All such documentsare hereby incorporated herein by reference in their entirety for allpurposes.

EQUIVALENTS

Various modifications of the invention and many further embodimentsthereof, in addition to those shown and described herein, will becomeapparent to those skilled in the art from the full contents of thisdocument, including references to the scientific and patent literaturecited herein. The subject matter herein contains important information,exemplification and guidance that can be adapted to the practice of thisinvention in its various embodiments and equivalents thereof.

What is claimed is:
 1. A system for testing a communication line,comprising: a jack for connection to the communication line; a samplercoupled to the jack; a processor in communication with the sampler; anda non-transitory memory coupled to the processor; wherein the system isconnected via the communication line to a second system substantiallysimilar to the system; wherein each system is operable to perform apredefined inbound test and a predefined outbound test; wherein thepredefined inbound test comprises: receiving a plurality of knownfrequencies sent sequentially by the other system; sampling theplurality of known frequencies in sequence as they arrive to generate asampled version of the plurality of known frequencies; storing thesampled version of the plurality of known frequencies in thenontransitory memory; and measuring a quality of the sampled version ofthe plurality of known frequencies; and wherein the predefined outboundtest comprises sending the plurality of known frequencies through thecommunication line one after another.
 2. The system of claim 1, whereinthe jack receives a signal via a phone cord plugged into the base unitof a telephone.
 3. The system of claim 1, wherein the system is operableto perform the predefined outbound test by: executing, using theprocessor, instructions that cause the processor to issue a digitalsignal and send the digital signal to the sampler; converting, using thesampler, the digital signal into an analog signal comprising a pluralityof known frequencies; and sending the plurality of known frequenciesseparately and in sequence through the communication line.
 4. The systemof claim 1, wherein the sampler comprises a digital storageoscilloscope.
 5. The system of claim 4, wherein the communication lineis connected to the system with a USB connection, the jack comprises a4P4C connector, and the sampler further comprises a handset jack forconnection to a handset of a telephone.
 6. The system of claim 1,wherein the quality measured in the sampled version of the plurality ofknown frequencies comprises noise and jitter.
 7. The system of claim 1,wherein the system is further operable to perform a predefined inboundextended test and a predefined outbound extended test, wherein thepredefined inbound extended test comprises: receiving at least fiveknown frequencies, at least one of which is below 1000 Hz and at leastone of which is above 3000 Hz, the at least five known frequencies sentsequentially by the second system; sampling the at least five knownfrequencies to generate a sampled version of the at least five knownfrequencies; storing the sampled version of the at least five knownfrequencies in the nontransitory memory; measuring a quality of thesampled version of the at least five known frequencies; and determiningwhether the communication line cannot operate in a secure mode; andwherein the predefined outbound extended test comprises sending the atleast five known frequencies through the communication line one afteranother.
 8. The system of claim 7, wherein the receiving the at leastfive known frequencies comprises receiving at least five megabytes persecond for at least five seconds.
 9. A method for testing acommunication line, comprising: using an apparatus to perform apredefined inbound test and a predefined outbound test, the apparatuscomprising a sampler coupled to a jack for connection to a communicationline and a processor coupled to a non-transitory memory and incommunication with the sampler, wherein the apparatus is connected viathe communication line to a second apparatus substantially similar tothe system, and further wherein: a predefined inbound test comprisessequentially receiving from the other apparatus an analog signalcomprising a plurality of known frequencies through a communicationline, sampling the plurality of known frequencies to generate a sampledversion of the plurality of known frequencies, storing the sampledversion of the plurality of known frequencies in the non-transitorymemory, and measuring a quality of the sampled version of the pluralityof known frequencies; and a predefined outbound test comprises sendingto the other apparatus a plurality of known frequencies through thecommunication line one after another.
 10. The method of claim 9, whereinthe measuring is performed on a digital copy of the sampled version ofthe plurality of known frequencies after the sampled version of theplurality of known frequencies has been stored in the non-transitorymemory.
 11. The method of claim 9, wherein the plurality of knownfrequencies is sampled at a sampling rate between about 100 kHz andabout 1000 kHz.
 12. The method of claim 9, wherein the analog signal isreceived from a telephone base unit.
 13. The method of claim 9, whereinthe measuring comprises measuring noise and jitter.
 14. The method ofclaim 9, wherein: a predefined inbound extended test comprisessequentially receiving an analog signal comprising at least five knownfrequencies spanning about 2000 Hz through a communication line,sampling the at least five known frequencies to generate a sampledversion of the at least five known frequencies, storing the sampledversion of the at least five known frequencies in the non-transitorymemory, measuring a quality of the sampled version of the at least fiveknown frequencies, storing a measurement of the quality of the sampledversion of the at least five known frequencies, providing themeasurement to a user, and determining a suitability of thecommunication line for secure operation; and a predefined outboundextended test comprises sending the at least five known frequenciesthrough the communication line one after another.
 15. The method ofclaim 14, further wherein the predefined inbound extended test comprisesreceiving at least two megabytes per second for at least two seconds.16. The method of claim 14, wherein at least one of the at least fiveknown frequencies is below 1000 Hz and at least one of the at least fiveknown frequencies is above 3000 Hz.
 17. The method of claim 14, furtherwherein the outbound extended line test further comprises sending the atleast five known frequencies as analog signals through the communicationline.